Large Deviations for a Class of Nonhomogeneous Markov Chains1 by Zach Dietz
نویسندگان
چکیده
Large deviation results are given for a class of perturbed nonhomogeneous Markov chains on finite state space which formally includes some stochastic optimization algorithms. Specifically, let {Pn} be a sequence of transition matrices on a finite state space which converge to a limit transition matrix P . Let {Xn} be the associated nonhomogeneous Markov chain where Pn controls movement from time n− 1 to n. The main statements are a large deviation principle and bounds for additive functionals of the nonhomogeneous process under some regularity conditions. In particular, when P is reducible, three regimes that depend on the decay of certain “connection” Pn probabilities are identified. Roughly, if the decay is too slow, too fast or in an intermediate range, the large deviation behavior is trivial, the same as the time-homogeneous chain run with P or nontrivial and involving the decay rates. Examples of anomalous behaviors are also given when the approach Pn → P is irregular. Results in the intermediate regime apply to geometrically fast running optimizations, and to some issues in glassy physics.
منابع مشابه
Large deviations for a class of nonhomogeneous Markov chains: K-word level results
In previous work, Dietz and Sethuraman (2005), large deviations with respect to additive functionals were established for a class of finite-state time-nonhomogeneous Markov chains whose connecting transition matrices {Pn} converge to a general limit matrix P which includes some stochastic optimization algorithms. In this note, large deviations at the next level, that is with respect to K-word e...
متن کاملOccupation laws for some time-nonhomogeneous Markov chains
We consider finite-state time-nonhomogeneous Markov chains whose transition matrix at time n is I + G/nζ where G is a “generator” matrix, that is G(i, j) > 0 for i, j distinct, and G(i, i) = − ∑ k 6=iG(i, k), and ζ > 0 is a strength parameter. In these chains, as time grows, the positions are less and less likely to change, and so form simple models of age-dependent time-reinforcing schemes. Th...
متن کاملLarge Deviations for a Class of Nonhomogeneous Markov Chains
Large deviation results are given for a class of perturbed non-homogeneous Markov chains on finite state space which formally includes some stochastic optimization algorithms. Specifically, let {Pn} be a sequence of transition matrices on a finite state space which converge to a limit transition matrix P. Let {Xn} be the associated non-homogeneous Markov chain where Pn controls movement from ti...
متن کاملModerate Deviations for Time-varying Dynamic Systems Driven by Nonhomogeneous Markov Chains with Two-time Scales∗
Motivated by problems arising in time-dependent queues and dynamic systems with random environment, this work develops moderate deviations principles for dynamic systems driven by a fast-varying nonhomogeneous Markov chain in continuous time. A distinct feature is that the Markov chain is time dependent or inhomogeneous so are the dynamic systems. Under irreducibility of the nonhomogeneous Mark...
متن کاملOn $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کامل